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SYSTEMS AND METHODS FOR PROVIDING ILLUMINATION 
IN MACHINE VISION SYSTEMS 

Cross-references to Related Applications 
5 This Application claims the benefit, under 35 U.S.C. §120, as a continuation 

(CON) of U.S. Non-provisional Application Serial No. 09/944,523, filed August 31, 
2001, entitled "Systems and Methods for Providing Illumination in Machine Vision 
Systems," which application in turn claims priority to U.S. Provisional Application 
Serial No. 60/229,849, filed September 1, 2000, entitled "Machine Vision." Each of the 
10 foregoing applications is hereby incorporated herein by reference. 

Background of the Invention 

1. Field of the Invention 

15 The invention relates to machine vision systems. More particularly, this 

invention relates to lighting systems for machine vision systems. 

2. Description of Related Art 

Machine vision systems have been in use for many years. These systems are 
20 designed to remove the human element from the manufacturing and inspection process. 
Many manufacturing and inspection operations are not necessarily difficult but they are 
boring. It is the boredom of these tasks that causes people to become unfocused during 
the operation, leading to defects in the product. 

Vision systems traditionally have used monochrome or gray scale systems to 
25 capture the images of objects. These systems typically view the object through a video 
camera to determine particular attributes of the object. The system may be used to 
determine if a particular attribute is present or if it is properly oriented or located within a 
predetermined area. These systems may provide feedback during the manufacturing 
process or they may be used off-line as inspection devices or manufacturing aides. The 
30 feedback system may include a computer controlled feedback loop or it may be provided 
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through human interaction. The scales of gray may be appropriate for determining some 
material attributes such as size, shape or color differences; however, when the degrees of 
differentiation between similarly colored parts is slight, a color system may be required. 
Thus, color recognition systems have also been incorporated into machine vision systems 
5 for more complex tasks. All of these systems rely on a sensory input device, typically a 
camera, a processor and a lighting device, to control the lighting of the object to be 
analyzed. The advent of powerful computing systems has allowed the development of 
the colored system. These color systems require more computations per second because 
of the complexity of the system. Many of these systems work on high-speed productions 

10 lines where any reduction in speed is intolerable, necessitating the need for increased 
computational power. 

Lighting is a vital part of both the gray-scale and color systems. If the lighting 
does not create the proper contrast or color, the system will slow down, give false 
indications, or completely fail to operate. Several lighting systems are available for these 

15 vision system applications. 

Vision systems typically require a light source with full visible-spectrum light 
emission. The light source produces light and the light is reflected off of an object to be 
inspected. The sensing system (e.g., camera) collects the reflected light and a processor 
analyzes the image for color and/or contrast. If the light source does not emit 

20 wavelengths compatible with the color of the object, the contrast between the targeted 
attribute and other attributes will be low. This low contrast can lead to false readings or 
false indications. To avoid such problems, vision systems generally use light sources 
that emit light throughout the visible spectrum. These light sources typically do not 
provide equal amounts of energy throughout the visible spectrum but they do emit some 

25 energy throughout most of the spectrum. In the case of an incandescent or halogen 
source, the red emission is high but the energy level is drastically reduced as the 
wavelength shortens, so there is very little blue emission. Fluorescent lamps tend to 
have gaps in the spectral output where there may be little or no emission. Once a light 
source is selected and the vision system is programmed, it is important that the lighting 

30 conditions remain constant. If the lighting conditions change, the reflected light and the 
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resulting image may also change. Periodic calibrations may be provided to compensate 
for changing conditions within the light source. 

There are several methods for analyzing the reflected light. One such method is 
referred to as the RGB or red, green, blue method. The RGB method involves 
5 representing all colors as a mixture of red, green and blue which constitute the primary 
colors used by video cameras, televisions, and PC monitors. When combined, these 
colors can create any color within the visible light spectrum. The second method is 
referred to as the HIS or hue, saturation and intensity method. HIS is based on how 
humans perceive color so the method is more intuitive than RGB. The method of data 

10 interpretation depends on the complexity of the task. Where coarse degrees of color 
separation are required, such as when identifying a red component from a green 
component, the RGB method may be chosen. Where the degrees of color are much finer, 
such as sorting pharmaceutical tablets or inspecting fruit, the HIS method may be used. 
Many other methods of data interpretation and manipulation could be used or developed. 

15 Lighting is an integral part of all vision systems and it would be useful to have a 

lighting system incorporated into the vision system. It would also be useful to have the 
vision system communicate with the lighting system to create various effects. 

Summary of the Invention 
20 One embodiment of the present invention is directed to a machine vision system 

comprising a first processor, and a lighting system capable of producing and modulating 
light, wherein the first processor communicates lighting command signals to the lighting 
system. 

An embodiment of the present invention is directed to a method of lighting an 
25 object or surface in a machine vision system. The method comprises acts of providing a 
machine vision system, providing a lighting system capable of producing and modulating 
light, and communicating lighting command signals from the machine vision system to 
the lighting system. 

Another embodiment of the present invention is directed to a method of lighting 
30 an object or surface in a machine vision system. The method comprises acts of 
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providing a machine vision system that includes an optica! system for viewing an object; 
providing an object; arranging the optical system to view the object; arranging a lighting 
system to irradiate the object, wherein the lighting system is capable of producing and 
modulating light; communicating first lighting control commands from the machine 
5 vision system to the lighting system; and executing a machine vision function and then 
having the machine vision system communicate second lighting control commands to the 
lighting system. 

Brief Description of the Drawings 
10 The following figures depict certain illustrative embodiments of the invention in 

which like reference numerals refer to like elements. These depicted embodiments are to 
be understood as illustrative of the invention and not as limiting in any way. 

Figure 1 illustrates a machine vision system according to one embodiment of the 
present invention; 

15 Figure 2 illustrates a lighting system that can be used with the machine system of 

Figure 1 ; and 

Figure 3 illustrates a flow diagram of a lighting process for a machine vision 
system to one embodiment of the present invention. 

20 Detailed Description of the Illustrative Embodiment s) 

The description below pertains to several illustrative embodiments of the 
invention. These are described merely for illustrative purposes, as the scope of the 
invention is not to be limited in any way by the disclosure below. 

The development of high brightness LEDs and the development of digital 

25 lighting technology has created many opportunities for LED lighting. U.S. Patents 
6,016,038 and 6,21 1,626 describe many such lighting devices. U.S. Patents 6,016,038 
and 6,21 1,626 are hereby incorporated by reference herein. These patents describe 
methods of controlling the light output from a lighting system comprised of different 
colored LEDs for example. Embodiments of these patents describe the use of pulse 
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width modulation (PWM) and independent control of the LEDs to produce varying color 
within a color spectrum. 

In one embodiment of the present invention, an LED lighting device with color 
changing capabilities may be used to illuminate objects in a vision system or machine 

5 vision system. The device may be an independently controlled device with operator 
control or the device could be incorporated into the machine vision system. The lighting 
device may also be networked to other devices in the manufacturing or inspection 
system. As an example, an upstream process change may take place and a signal could 
be sent to the lighting device to change its mode of operation. If the lighting device was 

10 incorporated into the vision system, the vision system processor may control the 

operation of the device. A light detection unit could also be employed to constantly or 
periodically measure the light output from the lighting device. This information could be 
used to recalibrate the device for overall intensity or particular wavelengths. 

A lighting device according to the principles of the present invention may include 

15 two or more different colored LEDs or it could have a single colored LED. The 

intensities of the respective LEDs could be varied and controlled through pulse width 
modulation or other LED control techniques. This system may be suited for color 
changing effects but it may also be used in a constant color mode. This system may be 
used for vision applications that require fast activation times, such as on a high-speed 

20 production line. The LED device can be turned off or the intensity reduced during the 
periods where the product or objects are being transferred into the vision station and be 
reactivated during the period of desired exposure. The LED system may also be used for 
providing saturated colors with high energy at wavelengths where other light sources 
cannot produce. With red, green and blue LEDs, the high energy can be produced in all 

25 three of these areas, as compared with halogen lamps that produce very little radiation in 
the blue and fluorescent lamps that have gaps in one of these areas. Any variation of 
hue, saturation, and intensity can be made with a combination of LEDs. The LED 
control signals can also be adjusted to avoid any mismatch between the video capture 
rate and the lighting. Another unique attribute of the LED device is that it activates so 

30 quickly that the lighting can give a strobing effect. This can be used on continuous flow 
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systems where the strobe rate appears to freeze the objects so they can be viewed. The 
strobing effect is commonly used where high-speed visualization is required, however, 
an LED system according to the principles of the present invention can provide strobing 
in different colors. The rate of strobe and the rate of color change may be independent 
5 and may be controlled through the vision system or as an independent device. 

Another example of the usefulness of a system according to one embodiment of 
the present invention is where the vision system needs to recognize several colors. The 
lighting effects can change as the system recognizes the attributes. If the object being 
viewed by the system has a blue and red wires that need to be identified, the system can 

10 activate the blue LEDs to create contrast between the blue wire and its surroundings and 
then perform a similar function with the red LEDs activated for the red wire. When only 
the blue LEDs are on, the blue wire will reflect the light and the red wire will not, 
enabling the blue wire to be easily identified. This is merely one simple example of an 
identification method that can be employed using an LED light source - many other 

15 recognition patterns are possible. This example serves to illustrate that the lighting 

effects can quickly and easily be changed to suit the particular application. Techniques 
using the principles of the present invention may also reduce the undesirable effects 
caused by uncontrolled changing lighting conditions. The high contrast provided by 
such a system may reduce or eliminate the need for calibration of the lighting system. 

20 In one embodiment, a lighting system may also be used in conjunction with other 

lighting devices or filters to create other desired effects. Moving filters can be used with 
this system and may be desired when the filters create a desired lighting effect and the 
speed of the system is not as critical. 

Another example of the advantages of using a device as described herein is where 

25 ultraviolet light is required to image the object or where both ultraviolet and visible or 
infrared are required. The vision system can be configured to receive the ultraviolet, 
visible and/or infrared radiation to make these lighting effects useful. The system can 
then activate the LEDs separately or simultaneously to provide various effects. Many 
objects reflect or fluoresce under ultraviolet light and thus can be easily identified 

30 through ultraviolet irradiation. These effects may be most pronounced when radiation is 
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limited to the ultraviolet and in this case the ultraviolet radiation and identification 
process could take place before any visible identifications where made. Again, these 
lighting conditions can be changed almost instantaneously to provide fast system 
response. 

5 Another method of computer vision involves creating three-dimensional shapes 

through the analysis of images and shadows cast on the image. The shading produced 
when an object is illuminated can be used effectively to recover its shape, reflection 
parameters, and also the direction and characteristics of the light source illuminating it. 
A lighting system according to the principles of the present invention may be used in 

10 such computer vision systems. The addition of color control may also aid in the 
reconstruction of the surface texture and color. By controlling the wavelength of 
radiation to more precise limits, the reflectance properties can be better approximated 
leading to a superior rendition of the surface properties. 

Figure 1 illustrates a machine vision system 100 according to one embodiment of 

15 the present invention. In this embodiment, the machine vision system is constructed of 
several elements such as a lighting system 1 14, a vision system (e.g., camera) 108, and 
an assembly apparatus 110. These elements may be considered peripherals to the central 
machine vision system 102. The machine vision system may include a processor 104 
that controls and/or receives data from the peripherals 108, 1 14, and 110. The vision 

20 system 108 may be arranged to view an object 1 12. The object 112 may be any object, 
surface, or material and may be the subject of inspection or manufacture by or through 
the machine vision system. In another embodiment, the machine vision system 102 may 
not include assembly apparatus 110, because the primary objective of the system 102 
may be inspection rather than assembly. 

25 In one embodiment, the lighting system 1 14 may be associated with the processor 

104 such that the processor directs commands to the lighting system 1 14 and the lighting 
system 1 14 responds by changing the illumination conditions in accordance with the 
commands. In one embodiment, the lighting system 1 14 is an LED lighting system 1 14 
and the LED lighting system 1 14 may receive control signals from the processor 104. 

30 For example, the LED lighting system 1 14 may include one or more LEDs and the 
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processor may generate and communicate control signals to the LED(s). The control 
signals may be pulse width modulated signals, pulse amplitude modulated signals, pulse 
displacement modulated signals or other modulated signals. The control signals may 
also be analog control signals (e.g., voltage, current, power control signals). In another 
5 embodiment, the lighting system 1 14 may include a second processor 202 (Figure 2) 
wherein the processor 104 communicates lighting control signals to the second processor 
202. The second processor 202 may receive and interpret the lighting control signals and 
generate lighting element control signals. For example, the processor 104 may 
communicate lighting control signals indicating a specific value for the hue, saturation 

10 and intensity of the light to be generated by the lighting system 1 14. The second 
processor 202 may receive the control signals and generate lighting element control 
signals to control the lighting element(s) of the lighting system 1 14. In one embodiment, 
the lighting system 1 14 may be an LED lighting system 1 14 wherein the LED lighting 
system 1 14 includes a second processor. As shown in Figure 2, the LED lighting system 

15 114 may also include several LEDs of different colors (e.g., red 204, green 208 and blue 
210). The second processor may, for example, control the LEDs independently with 
pulse width modulated signals to change the light emitted from the lighting system 114. 

In one embodiment, the lighting system 200 (Figure 2) may be included in a 
lighting system 1 14, and includes a processor 202 and one or more LEDs 204, 208, 210. 

20 The LEDs in this example are illustrated as red 204, green 208, and blue 210, but the 
LEDs may be any color suitable for the user's task. The processor 202 may include a 
data input 212. In one embodiment, the machine vision processor 104 may communicate 
lighting control signals to the lighting system processor 202 through the data input 212. 
The communication may be accomplished through wired or wireless communication 

25 techniques. 

The vision system 108 may be a color vision system or a gray scale (e.g., shade 
of one color) or other system. Changing the lighting conditions on the object 1 12 can 
increase the contrast between sections of the object 1 12 in either a color system or a gray 
scale system, and as a result, an intelligent lighting system 1 14 may be useful in either 
30 system. 
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In one embodiment, the lighting system 1 14 may be capable of producing varying 
degrees of color (e.g., hue, saturation and intensity) and the color may include ultraviolet 
spectra, infrared spectra or other spectra. In one embodiment, the lighting system may 
be an LED lighting system with three colors (e.g., red 204, green 208 and blue 210) and 
5 these individual or groups of LEDs may be varied in intensity. As the light from these 
LEDs combines, a combined color is formed (additive color mixing) and the varied 
intensities may cause the combined color to change. For example, the machine vision 
system may be viewing the object 1 12 through the vision system 108 wherein the 
processor 104 is attempting to locate a blue portion of the object 1 12 (e.g., a wire), so the 

10 processor 104 may communicate lighting control signals to the lighting system such that 
the lighting system produces blue light to increase the contrast between the blue wire and 
the other portions of the object 1 12. In one embodiment, the processor 104 may attempt 
to find another portion of the object 1 12 (e.g., a red wire) and the processor 104 may 
communicate lighting control signals to the lighting system 1 14 to change the light to red 

15 before attempting to locate the red wire to increase the contrast between the red wire and 
other portions of the object 1 12. This is just one example of how a machine vision 
system 102 with a controllable lighting system 1 14 according to the principles of the 
present invention can be used to increase the effectiveness of such a system, and it 
should be understood that such a system may be used in a variety of ways. 

20 In one embodiment, the machine vision system 102 may be associated with more 

than one lighting system 1 14. More than one lighting systems 1 14 may be used to light a 
same object 1 12, or the lighting systems 1 14 may be used to light more than one object 
112. For example, an object 1 12 may be lit with two or more lighting systems 1 14 to 
provide irradiation from different angles or for different cameras 108. The machine 

25 vision system 102 may direct lighting commands to the first lighting system such that the 
object is lit and the first camera identifies a portion of the object and then the machine 
vision system may direct a new command to the first lighting system 1 14 (e.g., turning it 
off) followed by lighting commands for the second lighting system 114. In this 
arrangement, it may be useful to provide addressable processors in the lighting systems 

30 114 such that they can read network commands to simplify the communication system. 
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In another embodiment, it may be desirable to have direct communication from the 
machine vision system 102 to the lighting systems 1 14. 

One of the advantages of providing a lighting system 1 14 that is comprised of 
LEDs is that the LEDs can react very quickly. The LEDs can produce full output and 

5 then return to zero output within frame rates of the vision system. This means an LED 
lighting system 1 14 can change the lighting effects or illumination conditions provided 
to the object 112 within the time it takes the machine vision system to recognize the 
portion of the object 1 12 it is attempting to identify. This provides a machine vision 
system 102 that can change the illumination conditions for each operation it under takes 

10 without slowing the equipment, which can be important in some applications. 

Although many of the embodiments herein describe LED lighting systems 114, in 
other embodiments the lighting system may be comprised of illumination sources other 
than LEDs. For example, the lighting system 1 14 may include a fluorescent, 
incandescent, halogen, high intensity discharge or other illumination source. In one 

15 embodiment, one of these other illumination sources may be combined with LEDs to 
form the lighting system 114. For example, the lighting system may be arranged with a 
halogen illumination source and an LED illumination source such that the machine 
vision system 102 can direct lighting commands to the lighting system 114 to control the 
halogen and LED illumination sources. 

20 Figure 3 is a flow diagram of a process 300 according to one embodiment of the 

present invention. In this embodiment, the first act 302 is to irradiate an object, surface 
or the like with light from a lighting system. The lighting system may be capable of 
changing the properties of the light produced from the lighting system. A vision system 
may then be provided to view and capture an image of a portion of the object (act 304). 

25 The illumination conditions provided by the lighting system may be used to alter the 

image as viewed or captured. The image then may be communicated to a machine vision 
system in act 308. The machine vision system may be arranged to then perform an 
inspection, manipulation or other function (act 310) and then direct new lighting 
commands to the lighting system to change the illumination conditions provided to the 

30 object (act 312). In response to the lighting commands, the lighting system may then 
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change the hue, saturation and/or intensity of the light produced by the lighting system 
(act 314) to provide new lighting conditions for the next portion of the object to be 
identified. While this process can be implemented in numerous ways, in an embodiment 
the process is executed on a processor (e.g., 104 in Figure 1) in the machine vision 
5 system. 

As used herein, the term "LED" should be understood to include light emitting 
diodes of all types, light emitting polymers, semiconductor dies that produce light in 
response to current, organic LEDs, electro-luminescent strips, and other such systems. 
An "LED" may refer to a single light emitting diode having multiple semiconductor dies 

10 that are individually controlled. It should also be understood that the term "LED" does 
not restrict the package type of the LED. The term "LED" includes packaged LEDs, 
non-packaged LEDs, surface mount LEDs, chip on board LEDs and LEDs of all other 
configurations. The term "LED" also includes LEDs packaged or associated with 
material (e.g., a phosphor) wherein the material may convert energy from the LED to a 

15 different wavelength. 

The term "illuminate" should be understood to refer to the production of a 
frequency of radiation by an illumination source. The term "color" should be understood 
to refer to any frequency of radiation within a spectrum; that is, a "color," as used herein, 
should be understood to encompass frequencies not only of the visible spectrum, but also 

20 frequencies in the infrared and ultraviolet areas of the spectrum, and in other areas of the 
electromagnetic spectrum. 

Having described several embodiments of the invention in detail, various 
modifications and improvements will readily occur to those skilled in the art. Such 
modifications and improvements are intended to be within the spirit and scope of the 

25 invention. Accordingly, the foregoing description is provided by way of example only, 
and is not intended to be limiting. The invention is limited only as defined by the 
following claims and the equivalents thereto. 
What is claimed is: 



